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A test of tau neutrino interactions with atmospheric neutrinos and K2K 
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The presence of a tau component in the flux of atmospheric neutrinos inside the Earth, due to 
flavor oscillations, makes these neutrinos a valuable probe of interactions of the tau neutrino with 
matter. We study - analytically and numerically - the effects of nonstandard interactions in the 
Ve — Vr sector on atmospheric neutrino oscillations, and calculate the bounds on the exotic couplings 
that follow from combining the atmospheric neutrino and K2K data. We find very good agreement 
between numerical results and analytical predictions derived from the underlying oscillation physics. 
While improving on existing accelerator bounds, our bounds still allow couplings of the size com- 
parable to the standard weak interaction. The inclusion of new interactions expands the allowed 
region of the vacuum oscillation parameters towards smaller mixing angles, 0.2 sin^ S23 0.7, 
and slightly larger mass squared splitting, 1.5 • 10~^ eV^ lAmlsl ^ 4.0 • 10~^ eV'^, compared to 
the standard case. The impact of the K2K data on all these results is significant; further important 
tests of the Ve, — Vr exotic couplings will come from neutrino beams experiments such as MINOS 
and long baseline projects. 
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I. INTRODUCTION 

Despite the remarkable successes of the Standard 
Model (SM), it is widely believed that there is new 
physics at the TeV scale, which stabilizes the Higgs mass 
against large radiative corrections. The search for this 
physics has been the goal of many key particle physics 
experiments of the last two decades. This search has 
been, and is being, carried out in two, often complemen- 
tary, directions: (i) efforts involving colliding particles 
at highest achievable energies, and (ii) efforts involving 
precision measurements at low energies. 

Here, we concentrate on the second possibility. There 
are many well-known examples of the low-energy tech- 
niques being very effective. For instance, precision mea- 
surements of atomic parity violation have resulted in an 
accurate determination of the interactions between the 
electron and u and d quarks mediated by the Z-boson 
0. Searches for exotic decays of the muon and pre- 
cision measurements of its anomalous dipole moment 1^ 
are placing important constraints on new physics at the 
TeV scale. Finally, searches for proton decay are sen- 
sitive to certain types of new physics all the way up to 
the scale of Grand Unification. 

This paper deals with another probe of this type, 
namely, the process of neutrino refraction in matter. 
More specifically, we will consider the refraction of the 
atmospheric neutrinos in the matter of the Earth and 
investigate the sensitivity of this process to new physics 
above the electroweak scale JTQj . The focus on neutrinos 
is motivated by the fact that they are the least tested 
particles of the Standard Model. While the charged lep- 
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ton sector has been extensively probed for many exotic 
modes (such as ^ e + 7, which has an upper limit 
of 1.2 X 10~^^ on its branching ratio), our knowledge 
about the neutrino sector is not nearly at the same level. 
While in certain classes of models it is possible to relate 
the properties of the two sectors, such relations do not 
have general character 0, making it necessary to probe 
the interactions of neutrinos directly. 

The most direct limits on the couplings of neutri- 
nos with matter are provided by experiments of scat- 
tering of neutrino beams on a target. Scattering tests 
the neutrino-matter cross section; results of this type 
are given by CHARM 0] and NuTeV and constrain 
mainly the coupling of the muon neutrino to matter, as 
described in Sec. IH ("I The interactions of the tau neu- 
trino, however, and of the electron neutrino in some chan- 
nels are still poorly restricted, being allowed at the same 
order as the Standard Model ones 5, 8]. To this end, 
oscillation experiments may possess an important advan- 
tage: while it is hard to produce a beam of tau neutri- 
nos in a laboratory, a very abundant flux of tau neutri- 
nos and/or antineutrinos is produced by oscillation from 
muon or electron-flavored fluxes. It is also important 
that scattering results are subject to obvious degenera- 
cies, for example in the complex phases of flavor-changing 
couplings, since they measure probabilities rather than 
amplitudes. Neutrino oscillations probe different combi- 
nations of NSI parameters with respect to accelerators 
and thus can help to resolve the degeneracies. 

The realization that oscillation experiments are sensi- 
tive to non-standard interactions (NSI) of the neutrino 
is, or course, very old. In fact, already in his seminal 
work [3, which laid the foundations for the MSW effect 

liol- lllj , Lincoln Wolfcnstcin focused on the possibil- 
ity that non-standard neutrino interactions may change 
the flavor composition of the solar neutrino flux. The 
idea was further developed in 0, and many other 
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subsequent works. Recently, the idea to use both solar 
and atmospheric neutrino oscillation as a way to measure 
the neutrino-matter interactions has been receiving pro- 
gressively more attention 3 IH IH IH Ts*, To", "la |2ll . 
The underlying physical argument is the following: both 
solar and atmospheric neutrino fluxes have been mea- 
sured over a range of energies and are fit very well by 
neutrino oscillations. One may hope, then, that the sys- 
tem is already overconstrained and the introduction of 
new physics would break the fit, thus opening the pos- 
sibility to constrain physics beyond the Standard Model 
strongly. 

The case of atmospheric neutrinos looks especially 
promising in this respect. The Super-Kamiokande (SK) 
experiment has collected data on the neutrino survival 
probability as a function of the zenith angle over five 
decades in neutrino energy, Ei, ~ [0.1, 10"*] GeV. All these 
data are very well fit with neutrino oscillations, with only 
two parameters [22, 23, 24] . Furthermore, this result is 
confirmed by an independent measurement of the neu- 
trinos from an accelerator beam at the K2K experiment 
|25j |. Thus, it is very natural to use atmospheric neutrinos 
as probes of NSI. 

The first investigations of this type 0, 0, indeed 
gave very strong bounds. It was shown that if the anal- 
ysis is restricted to two flavors 0, , and , one 
can constrain NSI down to the level of a few percent of 
the standard weak interaction couplings. It was shown 
later, however, that it is essential that the analysis be 
done with all three flavors ,21.] : the physical arguments 
for reducing the problem down to two flavors used in the 
case of the standard oscillation analysis no longer apply, 
in general, when one introduces NSI on top of vacuum 
oscillations. 

Within the framework of a three-flavor analysis it was 
shown 123] that the bounds derived in the two-flavor 
regime are relaxed when the Ve generation is included. 
The details of the argument are as follows. The high- 
energy sample is the most sensitive to matter effects. 
This happens since the vacuum oscillation Hamiltonian 
is inversely proportional to the neutrino energy, while the 
matter contribution to the Hamiltonian is energy inde- 
pendent. It turns out, however, that in a certain region 
of the parameter space the oscillations of high-energy at- 
mospheric neutrinos regain the character of vacuum os- 
cillations. The low-energy neutrinos remain in the vac- 
uum oscillation regime and an overall satisfactory fit to 
the data can be achieved. For very large NSI, the fit is 
eventually broken because the values of the oscillation 
parameters preferred by the high- and low-energy parts 
of the data become incompatible with each other. 

Our analysis in 21] was essentially limited to demon- 
strating the above point. In this work, we present the 
first comprehensive study of the effects of NSI in the e — r 



sector on the oscillations of atmospheric neutrinos. Our 
analysis here has both a numerical and an analytical part. 
We scan the full three dimensional space of the (effective) 
NSI couplings Cee, Serj Ctt, and present the allowed region 
(marginalized over the vacuum oscillations parameters) 
in the space of these quantities. We also discuss several 
generalizations, including subdominant effects like those 
of the non-zero Ois mixing angle and of the smaller, "so- 
lar" mass splitting. A third important aspect is that our 
analysis updates the previous ones by including the most 
recent results from the K2K experiment [25l ]. 

The text contains generalities in Sect. ^ where we give 
a general review of atmospheric neutrinos and neutrino 
oscillations with NSI. In Sect. lIIII we treat the problem of 
atmospheric neutrino oscillations in the presence of NSI. 
We describe various reductions to two-flavor oscillations 
(Sect, nil A|) and show how these help to understand the 
physics of the sensitivity of atmospheric neutrinos to NSI 
fSect- HlTBl) . In Sect. II VI we present a detailed numerical 
analysis of the problem, including the discussions of dom- 
inant (Sect. HV^ and subdominant effects (Sect. HVT^ . 
Our summary and conclusions follow in Sect. 



II. GENERALITIES 
A. Neutrino oscillations, masses and mixings 

The results of nearly all [tH ] available neutrino exper- 
iments can be explained assuming that the three known 
neutrinos, Ve,v^,i>T-, undergo flavor oscillations. As is 
well known, this means that neutrinos have flavor mix- 
ing and non-zero masses. 

Let us denote hy Vi (z = 1, 3) the neutrino mass eigen- 
states, and by their masses. In vacuum, the time evo- 
lution of these states is described by the kinetic Hamil- 
tonian, which is given by the relativistic dispersion rela- 
tion: E = y^jp+rn^ . The phenomenon of oscillations 
depends on the difference of the quantum phases of the 
mass eigcnstates; therefore, for the purpose of describing 
oscillations one can neglect the overall constant in the 
Hamiltonian. The Hamiltonian in the mass basis can be 
then written as follows: 

H^tc^ = Diag (-Ao - A, Ao - A, Aq + A) . (1) 

We use the notation A = ATO32/(4i?), Aq = 
Am2i/{4:E), with E being the neutrino energy and 
Am?- = rnf — m3. Here rrii <^ E has been assumed. 

The connection to the flavor basis I'a is provided by the 
matrix [/, defined as Va = UaiVi. We adopt the standard 
parameterization for U (see e.g. 2^), which contains a 
Dirac phase, 5, and the three mixing angles Oij-. 
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/l \ / cos 6*13 sin6li3e-^*\ / cos 6*12 sin 012 0\ 

U=lo cos6'23 sin6'23 1 -sin6'i2 cos6'i2 . (2) 

\0 -sin 023 cos 023/ V- sin 0136*-^ cos0i3 / V ij 



While the mass squared spHttings, Amfj, determine the 
frequency of the oscillations, the mixing angles control 
their amplitudes. In vacuum, no oscillations happen if 
the matrix U equals the identity (zero mixing angles) or 
if the three masses rrii are equal (zero mass splittings). 

In many physical situations, and in the assumption 
of purely standard interactions, observations happen to 
depend mainly on one mixing and one mass square split- 
ting, while the other parameters give small corrections. 
Conventionally, 0i2 and Am^i are assigned to describe 
the oscillations of solar neutrinos, while 023 and Am^g 
are used for atmospheric neutrinos. The third angle, 
013, gives small effects on both solar and atmospheric 
neutrinos; it is hoped to be tested with future preci- 
sion experiments involving neutrino beams. The sign of 
Am^g distinguishes between the two physically different 
configurations of the mass spectrum: the "normal" neu- 
trino mass hierarchy (Am^g > 0) and the "inverted" one 
(Amig < 0). 

It should be stressed that the possibility of reducing 
both solar and atmospheric neutrino evolution to two- 
state oscillations is an absolutely non-trivial result and 
should not be taken for granted. It relies on the measured 
smallness of the 0i3 mixing angle, and of Am^i relative 
to Am23. Moreover, it crucially depends on the matter 
interactions being standard. In the presence of nonstan- 
dard interactions, while the solar neutrino analysis can 
still be done with two states the atmospheric neu- 
trino case requires a full three- neutrino treatment '21*1. 



B. Fluxes of atmospheric neutrinos and 
experimental results 

Let us summarize the essential features of the fluxes 
of atmospheric neutrinos, and of the available data on 
them. We also mention tests of oscillations with other 
neutrino sources that are relevant to our discussion. The 
reader is referred to the literature for a more complete 
review IHIHIiill^. 

Atmospheric neutrinos are products of the absorption 
of cosmic rays in the atmosphere of the Earth. They pro- 
ceed from pion and kaon decays and, thus, are produced 
in the muon and electron species. Complex numerical 
models (see e.g. |3ll [32, y^, ISJj ISa, l2al ) have been devel- 
oped to predict how the flux of these neutrinos develops 
in the atmosphere; here we summarize the main features 
of these models. 

Both neutrinos and antineutrinos are produced in sim- 
ilar abundances. The energy spectrum of neutrinos de- 



tected at Super-Kamiokande spans several orders of mag- 
nitudes, from ^ 0.1 GeV to over a TeV. In the absence of 
neutrino oscillations, for energies higher than ~ 1 GeV, 
the muon (electron) neutrino flux is predicted to decrease 
as ~ E^^ (~ E^^-^) (see e.g. H^). At lower energy the 
spectrum is made more complicated by several factors, 
such as geomagnetic effects and solar modulations. 

At energies E ^ 1 GeV most muons decay in flight 
before reaching the ground. Correspondingly, for these 
energies, one expects at ground level a ratio of fluxes in 
the muon and electron flavors of about 2. This ratio in- 
creases with neutrino energy, as more and more muons 
reach the ground without decaying. Numerical models 
give the muon-to-electron neutrino ratio with a ~ 5% ac- 
curacy. By comparison, the uncertainty on the individual 
fluxes is significantly larger, ~ 20%. 

After a long and extensive effort of many different col- 
laborations, the Super-Kamiokande experiment has con- 
clusively demonstrated that atrnospheric muon neutri- 
nos undergo oscillations |2^ [2^ ^M- The indication of 
oscillations comes from the observation of an energy- 
and zenith-dependent muon neutrino and antineutrino 
fluxes. The different muon data samples at SK, which 
refer to different energy windows, show that at low en- 
ergy (sub-GeV events) and intermediate energy (multi- 
GeV events) the muon (anti)neutrino flux is suppressed 
at large zenith angles, suggesting a distance-dependent 
effect. The distance-dependent suppression is best seen 
in the multi-GeV events, due to the better alignment of 
the direction of the detected lepton with that of the in- 
coming neutrino. In the highest energy sample (through 
going muons, E ^ 10^ — 10^ GeV) the suppression is 
reduced in size for all zenith angles. It is important to 
notice that the electron neutrino flux is not tested in the 
same interval of energy: the e-like event sample reaches 
at most E ^ 10 GeV, beyond which absorption in the 
rock prevents detection. 

Detailed analyses of the SK data strongly favor oscilla- 
tions of into Vr, and, for purely standard interactions, 
give the parameters 

|Ato^2I ^ (1.7-3.6) • 10^3 eV^, 
sin^ 2023 - 0.85 - 1. (3) 

These numbers are taken from the 99% confidence level 
(C.L.) contours of the recent Super-Kamiokande paper, 
ref. [i^l; they agree with the results of our analysis (see 
Fig. 13 later in Sect. H7B)l . 

Several alternative neutrino conversion scenarios have 
been ruled out. For example, conversion into a purely 
sterile neutrino (vs) has been excluded, mainly due to 
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the non-observations of the —Vg matter effects inside 
the Earth [2^. A scenario in which neutrinos have no 
masses but oscillate in the Earth due to NSI is strongly 
disfavored too Non-oscillations mechanisms, 

like decoherence or neutrino decay are in strong tension 
with the data, especially with the presence of a minimum 
in the L/E event distribution at SK ^23\ (here L is the 
distance traveled by the neutrinos from production to 
detection). 

Given the picture of v^^v^ oscillations, one may ex- 
pect z^T--induced events in the SK detector and, in fact, 
there is a hint of the presence of such events p3| . 

Additional support for atmospheric neutrino oscilla- 
tions comes from the MACRO [Hllal 113 and Soudan2 
|4rt l4ll | atmospheric neutrino experiments, and - very 
importantly - from the K2K neutrino beam experiment 
[25l liq . K2K measures the flux and energy distribution 
(centered at ^ 1 GeV ) of muon neutrinos produced by 
an accelerator at a distance of 250 km from the detector. 
The results evidence an oscillatory disappearance of v^, 
with a region of oscillation parameters compatible with 
atmospheric results: 

\l^ml^\ - (1.2-5) • IQ-^ eV^ 
sin^ 26*23 - 0.25-1, (4) 

(99% C.L. interval). Small regions with larger mass 
squared splitting [few ■ 10^^ eV^) are also allowed by 
K2K at 99% C.L. 

In addition to ^23 and ATO32, the other vacuum pa- 
rameters are relevant to atmospheric neutrinos, as they 
contribute to subdominant effects. For this reason, we 
briefly summarize the status of the tests of these quanti- 



where e^^^ i^Lp^) denotes the strength of the NSI be- 
tween the neutrinos i' of flavors a and /3 and the left- 
handed (right-handed) components of the fermions / and 

/• 

The operators in Eq. ((T)) may arise from physics at 
a high energy scale, with new, heavy scalars and gauge 
bosons. While a theorist may prefer to see a concrete 
model leading to neutrino NSI, from the experimental 
point of view it is impractical to test any given model 
in isolation. The advantage of using effective low-energy 
operators is that they encompass the experimental effects 
of a variety of models, including, very importantly, those 
that have not been thought of yet. The four-fermion form 
is appropriate since propagator corrections are negligible 
even at the highest energies of the atmospheric neutrino 
spectrum, just like for the SM interactions. 



ties. 

The parameters 0i2 and Am|^ are measured with so- 
lar neutrinos and the KamLAND experiment 0, • A 
combined analysis of their data, with standard interac- 
tions only, gives [iMIi^: 

Am^i ~ (7-10) • 10"^ eV^, 
tan2 6'i2 ~ 0.4-0.55, (5) 

which corresponds to the Large Mixing Angle (LMA) so- 
lution of the solar neutrino problem. Interestingly, in 
presence of NSI other reg ions of the 9i2-^m\i plane be- 
come allowed [ll|ll|lj 

The mixing ^13 is strongly constrained by the non- 
observation results from short base-line reactor experi- 
ments. The most conservative limit compatible with the 
allowed interval of jArrigjI is: 

sin^ 6*13 < 0.02 , (6) 

as given by the CHOOZ experiment at 90% C.L. [sollsH . 
and supported by the results of Palo Verde '55| . 

C. NSI and the three neutrino oscillation 
Hamiltonian in matter 

When neutrinos propagate in a medium, an interac- 
tion term has to be added to the Hamiltonian to account 
for neutrino refraction in matter. For this, we consider 
the Standard Model (SM) weak interactions, and possi- 
ble NSI, both flavor changing (FC) and flavor preserving 
(FP). We can write the NSI Lagrangian in the form of 
effective four-fermion terms: 



(7) 

I 

The effect of standard and non-standard interactions 
on neutrino propagation is given by the sum over the 
contributions of the individual scatterers. This results in 
the Hamiltonian: 

ffmat = V^Gprie Cep ^f^t, > (8) 

in the flavor basis, up to an irrelevant identity term. Here 
rie is the electron number density of the medium and the 
definition tap = J2f=ude^af3''^f/''^<i accounts for above 
mentioned sum. We use e^^ = ei^ + e^^^ and e^^ = e-^J/" , 
because matter effects are sensitive only to the interac- 
tions that preserve the flavor of the background fermion 
/ (required by coherence ^5^) and, furthermore, only to 
the vector part of that interaction. 
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As mentioned in the introduction, the ee, er and rr 
NSI are the least constrained by direct measurements on 
neutrinos. Of these, we quote some results (valid at 90% 
C.L.) from 's'l, where each NSI coupling was analyzed 
isolated from the others: 

-0.6 eif <, 0.5 

\ei^\ ^ 0.5 . (9) 

We also have |e^^| ^ 0.1 and le^J^] 0.1, while aU the 
other epsilons have stronger bounds: jej^^l ^ 8 • 10^^, 
\ef^\ < 0.03 0. 

We note that these bounds are much weaker than the 
corresponding ones in the charged lepton sector. In many 
models, the latter can be carried over to the neutrinos by 
the SU{2) symmetry. Since the SU{2) symmetry is vio- 
lated, however, it is also possible that the NSI couplings 
receive S'[/(2)-violating contributions. For example, it 
was shown that certain dimension eight operators involv- 
ing the Higgs field |^, |1] affect the neutrinos but not the 
charged leptons. Thus, it is important to seek direct, 
model-independent limits on the neutrino interactions, 
and our work, it is hoped, contributes in this direction. 

Motivated by the loose limits in Eq. (jSJ, we focus on 
NSI in the i^e — Vt sector, take eefj,=^fj,T=^^iti— 0, and 
study in detail the oscillations of atmospheric neutrinos 
with the NSI described by Cee, ^er, ^tt- Setting and 
e^^ to zero is certainly justified in view of the strong 
direct limits on these couplings ^ . The case for e^,- is a 
bit more subtle. Arguments can be made that even for 
Eer?^ the sensitivity of the data to e„,T is essentially the 
same as in the two neutrino analysis Il4l[ . and therefore 
the bound | e^r \ ^0(10"^), found in [Ijl, should apply. 
We hope to return to this point in a future work. 

III. ATMOSPHERIC NEUTRINOS AND NSI: 
ANALYTICAL TREATMENT 

A. Reduction to two neutrinos 

As follows from Sect. Ill Al and III CI the oscillations of 
neutrinos in matter are described, in the flavor basis, by 
the Hamiltonian 

H^UH^tc^U^ +H^at- (10) 



In general, the density rig varies along the neutrino tra- 
jectory and the resulting time dependence of the Hamil- 
tonian is too complicated to allow an exact solution of 
the Schroedinger equation. Moreover, in presence of NSI 
on quarks there is a further dependence on the nucleon- 
to-electron ratio, and therefore on the chemical composi- 
tion of the medium. In spite of this, for purely standard 
interactions the oscillations of atmospheric neutrinos in 
the Earth is well approximated by a two neutrino oscil- 
lation, v^^Ut , on most of the energy spectrum. This 
is thanks to the smallness of ^13 and to the hierarchy of 
the mass splittings ( |Ar7i2i/Am|2| < 1). With NSI the 
problem is intrinsically different, and requires a different 
approach, as illustrated below. The analysis is carried 
out with = for simplicity; corrections due to ^13 
will be described in sec. IIV CI and Appendix IXI 

Let us start by considering the low energy part of 
the atmospheric neutrino spectrum: E ^ 0.1 — 1 GeV. 
Here we have |A| ^ ^/2GFne k, Aq, and a two neu- 
trino reduction is rather simple: the observations can 
be described in terms of dominant — Vt (vacuum) 
oscillations driven by A, with small corrections due to 
Ve-^v^j^ I oscillations driven by the solar scale Aq and 
matter effects. We will give more details on these in 
Sect. UvTI 

At higher energy, E ^ \ ~h GeV, we have ^f^Gpne ^ 
|A| 3> Aq. We can neglect the smaller mass splitting, 
and put A0 =0. In general, however, this approxima- 
tions is not enough to reduce to a two-neutrino problem, 
and so oscillations cannot be studied analytically. This 
follows from the fact that the mixing ^23 couples the z^^ 
and Vt flavors, and the flavor-changing NSI term egr cou- 
ples Vt with j/g. This is an important difference with 
respect to the case of SM interactions (or, more gener- 
ally, flavor-preserving interactions), where having ter = 
allows to decouple the v,, state and reduce to a v^^-Vt 
system. 

An important, nontrivial two-neutrino reduction is 
possible in the highest energy limit: yplGpne S> |A| 3> 
A0, which is well realized for i? ^ 10 GeV. As mentioned 
in Sect. Ill B1 at these energies the observed signal is just 
Vy^ and v^j^ disappearance, due to the absorption of elec- 
trons. Thus, the focus here is primarily on the conversion 
of v^J_ and i^^. 

To see the two neutrino reduction, it convenient to 
introduce the eigenvalues of El mat- 
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A^' -0 



2 

\plGpnc^ 



1-1- fee + Crr +^(1+ ^ee " 6^^)^ + 4| t„ V 



(11) 
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and the matter angles /? and ■0: 

tan2/3 = 2| Cer |/(1+ Cee - Err), 

2xP = Arg{e,r) ■ (12) 

First, consider a situation in which both of the 
matter eigenvalues dominate over the vacuum terms: 
lAT'lil^'^e'l » A A0. In this case, the mixing 
in the eigenstates of the Hamiltonian is suppressed by 

A/|Ae'| "C 1. This means the muon neutrino will not 
oscillate in the matter of the Earth, in conflict with the 
data. This case then can be excluded with confidence. 

Now, let us consider a very important case when the 
epsilons compensate to a certain degree to give a hi- 
erarchical scheme of the type |Ae'| S> A ~ |Ar'| or 
I At' I ^ A ~ |Ae'|. This is the case when the mention 
two-state reduction is realized. Indeed, the effects of the 



matter interactions decouple one of the neutrino states, 
while the vacuum term A drives the oscillations between 
the remaining two. 

Let us illustrate this for the situation |Ae'| ^ A ~ 
I At' I , since it is smoothly connected to the standard (no 
NSI) case and therefore appears more natural. Our re- 
sults can be easily generalized to the second scenario. 

It is convenient to take the matter eigenstates: 

Ve'^ cos/3 Ve -l- siu ^e"^*''' Vt , 

Vr'= - sin/3e2*'^ + cos (3 Vr ■ (13) 

In the basis of the primed states, the Hamiltonian has 
the form: 



H 



s|c2e + Ae'/A sps20e 
s/3S20e2"^ -C2e 

CpSp{l + 020 ) e^*'^ 326 C/3 



cpsp{l + C2e)e-^'^ 

S20Cp 

- + C?pC20 + At' /Ay 



(14) 



We see that the mixing of the state vj with the other two 
is suppressed, being of the order ^ A/|Ae'| ^ 1. Thus, 
this state decouples, and the problem reduces to v^-Vr' 
oscillations described by the 2-3 block of the Hamilto- 
nian H14|l . The unsuppressed oscillations of into a 
combination of v^. and Vr can account for the observed 
disappearance at high energy. 

The two-state v^-Vt' system is quite simple to deal 
with and indeed we may apply to it the known formalism 
for two-neutrino oscillations in matter, (see e.g. |3jIE3)j 
with At' playing the role of matter potential [73| . We find 
the effective mixing and mass splitting in matter: 



tan 29r, 



2s2eci3 



C20{l+cl)~sl + \r'/A' 



A. 



A 
2" 



C2e{l + 4) - si + ^ ) +4slgcl 



(;5) 



and the equation for the oscillation probability in 
medium with constant density: 



= sin^ 2d„i sin^ (A„ii) 



(16) 



The expressions (I15|l give 6m — d and A,„ = A if 
e^T^ErT— 0. Notice that along the direction eer— the 
matter eigenstates H13(l coincide with the flavor ones, and 
we recover the 2x2 problem of Refs. 14, 18], in which 
is decoupled, resulting in no sensitivity to eee- 
The properties of the probability P^h'f^—n'r') in 
Eq. (Unjl follow those of the MSW effect, with the 
possibility of resonant amplification of the oscilla- 
tion amplitude (sin20m = 1) when the condition 



C2e(l + c^) — Sp + At'/A = is realized. It is worth 
noticing that 9m and A^, and thus the probability 
P{v^^Vr'), do not depend on the phase of the e — r 
NSI term, V- 

Given its particular relevance for the analysis of at- 
mospheric neutrinos, we now comment on the limit of 
small At', i.e. |Ae'| » A 3> |At'|. This corresponds to a 
parabola in the space of the NSI couplings for fixed egg: 



I eer |V(l+eee) 



(17) 



If we take At' = in Eqs. (|15|l and (|16|l . we see that here 
the phase of the v^-Vr' oscillations has same dependence 
on the product A • L of vacuum oscillations, while at the 
same time the interaction with matter is far from negligi- 
ble, as it enters the probability through the angle (3. We 
also notice that the conversion does not depend on the 
sign of A (mass hierarchy) . It is also independent of the 
overall sign of the matter Hamiltonian, therefore neutri- 
nos and antineutrinos have the same oscillation probabil- 
ity. 



B. Expected sensitivity 

What values of eee, Cerj frr are compatible with the at- 
mospheric and K2K neutrino data? And, how does the 
presence of NSI change the allowed region in the space 
of 6*23 and Am|2? While to find the allowed region in 
the five-dimensional parameter space requires a numeri- 
cal scan, a good part of the relevant features of this region 
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can be understood from analytical arguments. Here we 
illustrate those. For simplicity, we first consider how the 
atmospheric neutrino data put constraints on NSI, and 
successively analyze how the K2K signal contributes to 
tighten those limits. 

Let us consider several different regimes. 

FP couplings only: eer= 0. Here we expect that prac- 
tically any value of tee will be compatible with the data, 
due to the decoupling of Ve, as explained in Sect. IHlXl 
In contrast, the data strongly constrain e^^. Indeed, e^^ 



influences the oscillations in the 



Vt sector, with 



possible conflict with observations. More specifically, an 
upper bound on Ctt comes from requiring that the v^'^Vr 
oscillation amplitude remains maximal over a large inter- 
val of energy, E ~ 10~^ — 10^ GeV, as indicated by the 
data. This can only be realized if ^23 is maximal and 
if the matter term remains subdominant to the vacuum 
ones even at the highest energies jj^- For neutrinos go- 
ing through the center of the Earth, the highest energy 
at which an oscillation minimum occurs in the standard 
case is around 



£;o - 20 - 30 GeV. 



(18) 



If we require e^-^ Gpne ^ Ato§2/(2^'o)j and use 
Am§2 ^ 2.5 • IQ-^ eV^, we find the bound e^^< 0.2. 
This agrees well with numerical results |23| (see sec. llVfl . 
We also expect no modifications of the allowed region of 
023 and Am§2 with respect to the standard case. 

Both FP and FC couplings: no cancellations. In the 
presence of flavor changing interactions, Eett^ 0, a more 
general bound on the NSI follows from the analysis of 
Sect, nil Al Let us begin with the "generic" scenario in 
which I At-' I, |Ae' I ^ A for E ^ Eq. This case is clearly ex- 
cluded. Indeed, in this case the i'^ mixing is suppressed 
(see Sect. IIII A|) . and thus the muon neutrino flux re- 
mains unoscillated, in clear conflict with the data. This 
scenario yields what could be called a "generic" bound 
on the epsilons: for example, we get | Cer | ^ 0.5 when 
eee~ 0. The bound depends on eee in a way that will be 
described later. 

Both FP and FC couplings: hierarchical scenario. We 
now analyze the "hierarchical" scenario, where |Ae'| S> 
A ~ \^t'\ for E ^ Eq. This configuration turns out 
to fit the data even for rather large values of Cer and 
err- To understand the reason, we can first focus on 
the limiting case Ar' = 0, corresponding to the parabolic 
direction in Eq. H17() . As explained in Sect. IIII Al in 
this circumstance the muon neutrino evolution allows a 
two-state Vfj^ — Vt' reduction and the resulting disap- 
pearance of has the all features of vacuum oscillations 
that are known to fit the data, namely the same L /E de- 
pendence and equal survival probabilities for neutrinos 
and antineutrinos. The fact that here oscillates into 
a combination of and and not into pure Vr as in 
the standard scenario, is inconsequential, since there are 
no e-like data available at ^ 10 GeV, as mentioned in 
sec. IIIBI Moreover, dX E <^ Eq vacuum terms are domi- 
nant and so vacuum oscillation features are recovered in 



the lower energy data samples. The result is an allowed 
region in the space of the NSI couplings centered along 
the parabola l(T7|l . 

Let us study the allowed region of the hierarchical case, 
and in particular its width and extent along the parabolic 
direction. The width of the region is given by the condi- 
tion |Ar'| < Am§2/(2-Eo), or, numerically: 



|1+ Cee + err - ^J {1+ iee - trrY + ^\ ^er ?\ < 0.4 . 

To determine the extent of the region, more complicated 
considerations are necessary. As a first step, let us ad- 
dress the question of how the NSI change the vacuum 
oscillations parameters reconstructed from the data. We 
expect that, if the multi-GeV and through-going muon 
events have a significant weight in the global fit to the 
data, for a given set of NSI in the region H19|l the al- 
lowed region in the space of 623 and Am§2 changes with 
respect to the standard case. Indeed, if NSI are present, 
but not included in the data analysis, a fit of the high- 
est energy atmospheric data, i.e. the through-going muon 
ones, would give Am^ and 0^ instead of the correspond- 
ing vacuum quantities. If we require that the measured 
6m is maximal, as favored by the data, Eq. I|15fl gives: 



cos 26*23 =^3^/(1 +4) , 



'32 



Am2„(l + cos-2/3)/2 , 



(20) 
(21) 

where (3 is the rotation angle between the NSI eigenba- 
sis and the flavor basis, Eq. H12|) . Interestingly, Eqs. 
(|20|l and (|21|l tell us that the vacuum mixing 6*23 would 
not be maximal and that Am|2 would be larger than 
the measured value. The fit to the high-energy dataset 
can be achieved, but only at the expense of modifying the 
vacuum oscillation parameters. At the same time, the 
low-energy (sub-GeV) dataset still has negligible matter 
effect and hence is best fit by maximal 6*23. Thus, for suf- 
ficiently large NSI, there will be a tension between the 
values of the oscillation parameters preferred by the low- 
and high-energy datasets. Avoiding this tension leads to 
a constraint on (3, which in turn translates into a con- 
straint on the epsilons. 

More specifically, one should impose that the angle 
given by Eq. (|20|l is larger than the minimum value of ^23 
- let us call it Omm - allowed by the low energy sample. 
This gives: 



cos^ (i > tan^ 9„ 



(22) 



which will cut off the potentially infinite parabola l|19() 
down to the shape of a smile (see sec. IIVII . Fits to the 
sub-GeV data sample give 9min — 0.52 [Sg. Using this 
value we get cos^ (3 ^ 0.3; this result is relaxed if we allow 
6m to be slightly away from 7r/4 in the derivation of Eq. 

Similarly, we have to require that the right hand side 
of Eq. (|21|l does not exceed the maximal mass splitting 



Animax allowed by the sub-GeV data, and obtain: 



cos^ (3 > 



2Ar 



Am'i 



(23) 
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For Am^„^ = 5.0 • IQ-^ eV^ ^ and Am^ ~ 2.5 • 
10~^ eV^ Eq. gives cos^ P ^ 0.3, comparable to what 
given by Eq. it^ . 

While Eq. (|19|l was given in our earlier work the 
results in Eqs. (|22|) and (|23|l are presented here for the 
first time. 

Let us check if the constraints in Eqs. H22|l and 123|) 
become stronger if we combine the atmospheric neutrino 
data with those from K2K. For the neutrino energies used 
at K2K and ^ 1, matter effects are negligible, and 
therefore K2K measures the vacuum parameters 023 and 
IATO32I. From the K2K limit on 6*23 we get the condition 
to avoid the tension between K2K and atmospheric data. 
The analogue of Eq. (|^ for K2K turns out to be looser 
than that from sub-GeV atmospheric events, while the 
condition on the mass splitting, Eq. (|23|l is important: 
using the K2K hmit, Am^ < 4.0 • lO'^ eV^ |2|, we find 
cos^ (3 ^ 0.45. Thus, the present K2K data constrains 
NSI by limiting the allowed range of Am^. 

If the opposite hierarchy of eigenvalues is realized, 
I At' I » A ~ l^e'l, similar considerations to those 
above apply. The allowed region in the space of the 
NSI couplings is now given by the requirement |Ae'| ^ 
Am32/(2i?o), or, numerically: 

|1+ eee + err + ^ee - ^rr + 4| |2| < 0.4 . 

(24) 

This condition can be satisfied for eee^ —i- It describes a 
region centered around the parabola H17|l oriented in the 
negative e,-r direction. Physically, this means that the 
contribution of eee overcompensates the standard mat- 
ter term and changes the sign of the e-e entry of the 
matter Hamiltonian. This is somewhat extreme but still 
compatible with accelerator limits (Eq. ©) and with the 
combination of solar and KamLAND data, provided that 
a certain combination of the other parameters (NSI and 
vacuum ones) is realized [iTllia]. 

As we decrease eee from eee~ down to eee~ —2a tran- 
sition from one limiting case (|Ae'| ^ A |Ar'|) to the 
other (|At-'| ^ A '--^ l^'^e'l) occurs. We expect this transi- 
tion to be continuous, meaning that for each fixed value 
of eee in this interval a region in the eer-err plane that is 
compatible with the data exists and varies smoothly with 
eee- This conclusion is justified by our earlier comment 
that atmospheric neutrino oscillations are insensitive to 
NSI in the direction eeT—erT= 0. Numerical results in- 
deed confirm the existence of such a continuous transition 
(see Sect. Hvj) . 



IV. ATMOSPHERIC NEUTRINOS WITH NSI: 
NUMERICAL ANALYSIS 

A. Combined analysis of atmospheric and K2K 
data 

We performed a quantitative analysis of the atmo- 
spheric neutrino data with five parameters: two "vac- 



uum" ones, (Am|2,023), and three NSI quantities (cge 
, eer, Err), whcrc Cer has bccu treated as real for simplic- 
ity. The parameter space was scanned and a goodness- 
of-fit analysis was performed for each grid point. 

In the analysis, we have used two types of codes. For 
many of the preliminary investigations we used our own 
code, which made several simplifying assumptions, but 
was designed to capture the relevant physical features 
of the atmospheric neutrinos in different energy ranges. 
For the final fits, we used a binary of the atmospheric 
neutrino program kindly provided to us by Michele Mal- 
toni (SUNY, Stony Brook). This binary is essentially the 
same program used in our earlier paper It uses the 
complete 1489-day charged current Super-Kamiokande 
phase I data set j53| , including the e-like and /x-like data 
samples of sub- and multi-GeV contained events (each 
grouped into 10 bins in zenith angle) as well as the stop- 
ping (5 angular bins) and through-going (10 angular bins) 
upgoing muon data events. This amounts to a total of 
55 data points. For the calculation of the expected rates 
the code adopts the three-dimensional atmospheric neu- 
trino fluxes given in Ref. 36]. The statistical analysis of 
the data follows the appendix of Ref. (I^. The binary 
underwent extensive testing in the course of this project 
and the feedback was reported back to the author. 

We have included the results of the K2K data analysis 
in our study, by adding our atmospheric to the K2K 

in the space of 023 and Ato§2 . The latter was provided 
by the K2K collaboration in tabular form, and refers to 
the published analysis of Ref. j2^] (Fig. 4 there). 

It is important to point out that in our analysis we 
use only NSI propagation effects. The detection effects 
are purposefully left out. The reason for this is that the 
changes in the detection cross sections due to NSI do not 
uniquely follow from the propagation effects, but depend 
on additional parameters and assumptions. As a result, 
the detection effects can vary significantly, from large to 
unobservable, depending on the underlying model of the 
NSI. 



1. NSI and detection effects 

Let US give a detailed argument for why possible NSI 
effects on the detection cross sections are not directly 
related to the propagation effects. A reader primarily 
interested in the results of our numerical analysis may 
wish to skip to Sect IIV ii\ 

Consider how the Super-Kamiokande collaboration ex- 
tracts NC information from their data. One method is 
to analyze a multi-ring dataset specifically enriched with 
NC events through a careful sequence of cuts psL Issf . 
Another method is to compare the rate of single 7r° 
events, most of which are produced in NC interactions, 
to the muon rate |59j |. In principle, only the collabora- 
tion can reliably model these data. Nevertheless, in what 
follows we set this consideration aside and ask: Can one 
in principle use these data to improve the bounds on NSI 
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FIG. 1: Sections of the function x^(£ee, Ett, Eet) along the planes of fixed eee (numbers in the Figure), from a combined fit of 
the atmospheric and K2K data. The epsilons shown are per electron. The vacuum parameters 623 and Am^2 a-re marginalized 
over. The latter is taken to be negative (inverted mass hierarchy). We have also used 613 = and neglected effects of the 
smaller mass splitting, Amli = 0. The contours, from the inner to the outer, correspond to 95%, 99% and 3a C.L. Only the 
positive Eer semi-plane is shown in each case for visual convenience; the negative Cer semi-plane is symmetric. More generally, 
the results are independent of the complex phase of e^r- 
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derived from propagation effects? 

The multi-ring dataset. The main contribution to this 
dataset is from muhi-pion production in the energy range 
0.5 — 10 GeV j58j- While the exact expression for 
the cross-section is quite complicated (SK uses a semi- 
empirical formula), a qualitative estimate may be ob- 
tained by assuming deep inelastic neutrino-parton scat- 
tering. In this case, the cross-section depends on the 
squares of the left- and right-handed couplings, gf^ and 
5fl • It is immediately obvious that the result depends 
on how the NSI effects are distributed between the u and 
d quarks. The value of the axial coupling, gA = 9l — 5_r, 
is also crucial (the refraction effects fix only the vector 
pa rt, q y = gL + gn)- For example, for the point used 
in 16], splitting NSI evenly between gj^ and gn and as- 
suming the standard value for gA, we find an increase in 
the cross-section of only 20%. The effect becomes even 
smaller once the axial coupling is adjusted to compensate 
the increase given by the vector part. Hence, no rigorous 
constraint can be obtained from this sample. 

The single tt'^ sample. The main contribution to the 
single TT*^ sample is from incoherent single pion produc- 
tion, followed by coherent single pion production 
The first process is dominated by the A resonance and is 
largely controlled by the size of the axial coupling [2^ . 
The second one is also axial: the neutral current cre- 
ates a pion that scatters on the nucleus [HSl- Hence, this 
sample would not constrain the vector interaction that 
is responsible for the modified matter effect. Also, it 
should be mentioned that the statistics in this sample 
is not sufficient to even separate the active-active from 
active-sterile scenarios. (The latter is disfavored by only 
1.3a, see [5^.) 

Lastly, a simple observation is that if the NSI are as- 
signed to electrons, they have no effect on the NC event 
rate in the detector, since the latter is dominated by scat- 
tering on nuclei. This makes especially clear that the 
propagation and detection effects need not be correlated. 
Only if strong model-dependent assumptions are made, 
like in the case of a sterile neutrino, can the two be used 
together to exclude an oscillation scenario. 

We emphasize that it is important for Super- 
Kamiokande and other neutrino oscillation experiments 
to be looking for any anomalous NC signal: an observa- 
tion of such signal would imply the discovery of NSI. At 
the same time, as the preceding examples show, a lack of 
such anomalous signal would not guarantee there are no 
NSI propagation effects. 



B. Main results: NSI, mixing and mass splitting 

Our main result involves a scan of the 
(cee, Eer , Ett, Am|2, ^'23) spacc for real ter, inverted 
mass hierarchy (ATO32 < 0), 613 = and Am^i = 0. 
Variations of the three latter parameters represent sub- 
dominant effects; the cases of different mass hierarchy 
and nonzero ^13 are treated later, in Sect. II VO 



The scan yields a five-dimensional allowed region. Var- 
ious projections of this region are described next, in Figs. 

The first result is the region allowed by the data in 
the space of the NSI. It was found by marginalizing 
the function over the vacuum oscillation parame- 
ters. The resulting function, x^i^ee,^eT,^TT), gives a 
3-dimensional allowed region, two-dimensional (eenCTT) 
sections of which are shown in Fig. ^(the values of eee for 
each section are shown in the Figure). As the region is 
invariant under eer*^ — ^er, only the positive Cer halves 
are shown for each section. The symmetry in the sign 
(phase) of eer is understood in terms of the oscillations 
probabilities, that were shown to depend on the absolute 
value of eer only (see sec. IIII B|l . 

The curves in the Figure are isocontours of Ax^ = 
- xliin = 7.81,11.35,14.16 (from the inner to the 
outer), corresponding to 95%, 99% and Scr C.L. The 
parabolic flat direction in the function x^(eee, Eer, Crr) 
predicted by Eq. IjlTI) is clearly seen. This direction 
is essentially determined by the atmospheric data, and 
is not altered significantly by the contribution of K2K 
(which, however, changes the extent of the region, as 
will be explained). The width of the parabolic region 
matches well the condition on the matter eigenvalues, Eq. 
p9|l , as was shown explicitly in Fig. 1 of ref. . The 
points where the region (at a given C.L.) ends along the 
parabola well follow isocontours of the angle (3 (specif- 
ically, cos^ /3 ~ 0.30, 0.35, 0.42 for the three confidence 
level contours in the figure), as expected from the "cut- 
off' conditions given by the low energy atmospheric sam- 
ple and by the K2K results, Eqs. if^ and 
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FIG. 2: The difference Ax^ (where is the same function 
of Fig. ^ plotted along the parabolic direction of Eq. 1)17^ , 
for three fixed values of tee (see legend). 

Along the parabola, the function x^i^ee, Cer, Crr) varies 
very slowly near the origin, and starts to increase ap- 
preciably only at eer of about 0.5 or so. For ex- 
ample, we have: x^(0,0,0) = 148.11 (no NSI) and 
X^(0.73, 0.35, 0.07) = 148.07. The latter happens to be 
the absolute minimum, Xmm' but clearly has practically 
the same goodness of fit as the origin. The curves Fig. [21 
show how Ax^ varies with Cer along the parabola H17|) 
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for three fixed values of Cee- 

As a side comment, we notice that the agreement with 
Eqs. l(T7| and fH^ becomes worse with the decrease of 
Cee- This makes sense because as e^e approaches —1, 
the two matter eigenvalues Ae' and Ar' have comparable 
size, thus breaking the approximation of hierarchy of the 
eigenvalues used in our derivations (sec. IIII A|) . Notice 
that the panel with tee= —1 shows a hint of transition 
from an upward to a downward parabolic region. This 
transition is expected to happen with the change of sign 
of the term 1+ tee in the matter Hamiltonian. 



incide with those obtained for normal hierarchy with e^e 
fixed at the upper limit, eee= 1-6- Since this upper limit 
is determined by accelerator experiments, improvements 
of the accelerator NSI bounds would lead to a better 
knowledge of the oscillation parameters. 

In the Table |I| we list the intervals allowed, at differ- 
ent confidence levels, for each vacuum parameter after 
marginalizing over all the other quantities. They exhibit 
features analogous to those of fig. 13 The results for the 
standard case are given, too, for comparison. 
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FIG. 3: The shaded areas represent the regions in the space 
of |Am|i| and sin^ ^23 allowed by the atmospheric neutrino 
and K2K data, obtained upon marginalizing over the NSI 
parameters. The regions correspond to the 95%, 99% and 
3cr confidence levels for 2 d.o.f. (innermost to outermost). 
We have marginalized also over the sign of Am^i and took 
— 1.6 <eee< 1.6, motivated by one of the accelerator bounds 
(see text). The corresponding regions obtained with purely 
standard interactions are shown for comparison. 



The second result is the allowed region in the space 
of 6*23 and |Am§]^|, obtained by marginalizing over the 
NSI parameters. This region is shown in Fig. O In the 
marginalization procedure we have restricted tee iu the 
interval —1.6 <eee< 1-6. This serves as an example, and 
corresponds to the CHARM bound if the NSI are present 
exclusively as fiavor-preserving interactions of Vf, on the 
right-handed down quark j3| . We have marginalized 
also over the sign of Ato§]^, thus including both mass 
hierarchies. Expectedly, with respect to the standard 
case, the allowed region is bigger, and extends to smaller 
mixing (sin^ ^23 — 0.2 instead then sin^ ^23 — 0.31) and 
slightly larger |Ato§]^|, in agreement with the analytic 
considerations (sec. IIII|I . The absolute minimum lies at 



'31 



= 2.6 X 10-3 eV^, sin^ 61 = 0.5. 
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We find that the contours in the figure practically co- 



FIG. 4: A section of the function x^(fee, trr, fier) along the 
plane e^e= 0.3, from a fit to atmospheric data only (upper) 
and the combined fit of atmospheric and K2K data (lower). 
All the considerations made for Fig. Q apply here. 
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The K2K results play an important role in restricting 
both the region of the oscillations parameters and that of 
the NSI couplings. This is shown in Figs. ElandEl Figure 
0] shows a representative section of x^(^ee, err, Cer) (the 
same function as in Fig. ^ along the plane tee= 0.3. 
The lower panel refers to the full atmospheric+K2K fit 
(like all the results in Figs. I1I3|I . while the upper one 
is obtained with atmospheric data only. The reduction 
due to K2K is evident: for example, the edge of the So- 
contour changes from {eer, ^tt) — (2-8, 6.0) to (een ^tt) — 
(2.2, 3.8). The effect is smaller for smaller NSI, as one can 
see that the 95% C.L. contour is practically unchanged 
between the two panels. 

Fig. O is a series of variations of Fig. O the results 
of the fit in the plane |ATO|]^|-sin^ 023 are shown with 
and without NSI, each with and without the inclusion of 
the K2K resuhs. We see that with NSI the K2K data 
contribute to restrict the parameters, especially in the 
region of large |Ato|]^| and small mixing. The 3ct contour 
of this region is moved from (sin^ 023, lAmg^^j) ~ (0.15,6- 
10-3 eV^) to {sm^e23, |Am§i|) ~ (0.21, 4- lO'^ eV^). We 
also observe a restriction of |Am§]^| from below, which is 
essentially the same in the cases with and without NSI. 



C. Subdominant effects: mass hierarchy, 813, three 
neutrino corrections 

Here we generalize our results to include subdominant 
effects, namely the effect of the sign of the mass hierar- 
chy, of a non-zero 613 and of the 1-2, "solar", oscillation 
parameters. 

Fig.|B|shows the allowed region in the space of the NSI 
parameters for normal mass hierarchy. Analogously to 
the case of inverted hierarchy shown in Fig. ^ the re- 
gion follows the parabola IjlTI) and its endpoints follow 
isocontours of /3. The main difference is that for normal 
hierarchy these isocontours are more restricted, i.e., the 
allowed range of NSI is smaller. Along the parabola, the 
grows faster with the epsilons for normal hierarchy, 
as shown in Fig. |7| For example, if eee= 0, the Scr C.L. 
contour ends at (eeneTr) ~ (1.0,1.0) for normal hier- 
archy, while we have (eerjerr) ^ (1.8,2.5) for inverted 
hierarchy. In terms of cos^ /3, the contours in Fig. |H| 
correspond to cos^ /? ~ 0.47, 0.53, 0.65 (compared with 
cos2 p ~ 0.30, 0.35, 0.42 for Fig. [TJ. 

From our analytics, we can see two sources of difference 
between the results for the two hierarchies. One traces 
back to the term Xr' / A in the 3-3 entry of the Hamil- 
tonian H14|) (see also Eq. H15|) 'l. This can be as large 
as Xr' / A ~ 0.2 in the allowed region of parameters (Eq. 
(|19|l ') and so is expected to contribute at the subdominant 
level. Secondly, corrections that depend on the sign of A 
arise also from the small, but not zero, coupling of the 
state Ve' with the other two. This depends on the 1-1 en- 
try of the Hamiltonian (|14|l and therefore on the relative 
sign of Ae' and A. Considering that the data are domi- 
nated by neutrinos over antineutrinos (due to the larger 



detection cross section, see e.g. [23), it makes sense that 
a larger allowed region of NSI is obtained for inverted hi- 
erarchy, where, for neutrinos, matter and vacuum terms 
have the same sign and thus suppress the mixing of i>f,' 
more than in the normal hierarchy case. 

Fig.lHlshows a generalization of Fig. ^to non-zero 013. 
Only the plane eee= is shown for illustration. The plot 
was obtained for 613 at the reactor limit, Eq. ((BJ, with 
013 > 0. From the comparison of Figs. |S1 and ^ it is 
clear that 0i3 breaks the symmetry in the sign of egr. 
While the parabolic direction of the region is unchanged, 
the position where the region ends along this direction is 
affected. These features can be understood analytically, 
as shown in Appendix 1X1 The effect of non-zero 0i3 on 
the extent of the allowed region in the space of |Am|]^|- 
sin^ 023 is small and is not shown here. 

Let us now comment on conversion effects in the lowest 
energy part of the atmospheric neutrino spectrum, corre- 
sponding to the sub-GeV events. Here oscillations driven 
by the Am^i vacuum terms and matter terms occur on 
top of faster vacuum oscillations due to Am^2- The re- 
sult is a deviation of the sub-GeV e-like events from the 
unoscillated prediction. This effect has been discussed in 
detail for the standard, no-NSI case [s^ l6lll6^ . It was 
found that the ratio of the fluxes of neutrinos of muon 
and electron flavors depends on Am2i through the prob- 
ability P(f2 —^i^e) of conversion of the mass eigenstate 1^2 
into Ve inside the Earth. This probability is multiplied 
by the flux factor = r cos^ 023 — 1, with r being the 
unoscillated ratio on muon and electron neutrino fluxes. 
The numerical coincidence cos^ 023 ^1/2 and r ^ 2 pro- 
duces a strong suppression of and thus of the conver- 
sion effect 61]. 

The generalization of this to NSI is immediate. Given 
the smallncss of the effect on absolute scale, with an im- 
pact on the fit to the data not larger than few per cents, 
we choose not to discuss it in detail. We mention two 
sources of enhancement of the conversion effect. The first 
is a possibly larger flux factor, due to a smaller 023, see 
sec. IIVBI The second is a larger probability P{i'2 ^^e) 
due to NSI. Indeed, if flavor-changing NSI are present, 
P{v2 -^i^e) converges to a non-zero value when matter 
terms dominate over the vacuum ones, in contrast with 
the standard scenario (see e.g. 0|). 

Finally, it should be pointed out that there exists an 
important identification in the parameter space. Indeed, 
physical results depend only on the relative sign of the 
vacuum and matter terms of the Hamiltonian. Because 
of this, for vanishing 0i3, the case of one hierachy maps 
onto the case of the other hierarchy with 
Cer^ ~ Eer, ^tt*^ ~ Ctt- This, cvcn though we have 
presented only the cases eee> —1, our results extend to 
Eee < — 1 ■ Explicitly, normal hierachy with Cee < — 1 maps 
to inverted hierarchy with tee> ~1, and, likewise, in- 
verted hierachy with eee< —1 maps to normal hierarchy 
with eee> —1- The cases eee~ ^1 for the two hierarchies, 
shown in Figs. ^ and El are clearly related by the trans- 
formation ^TT*-* ~ ^TT (and also but the 
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region is symmetric with respect to this tranformation). 



V. SUMMARY AND CONCLUSIONS 

We have explored the sensitivity of the atmospheric 
and K2K neutrino data to neutrino NSI in the e— r sector, 
and investigated how the presence of NSI can change the 
allowed region of the vacuum oscillation parameters. The 
results can be summarized as follows: 

1. The region of the NSI parameters tee,^TTi^eT al- 
lowed by the data is essentially determined by 
two conditions on the neutrino-matter interaction 



Hamiltonian. The first condition is that one of the 
eigenvalues not exceed the vacuum term at high 
energy - 20 - 30 GeV): |Ar'|/A 1 or, numer- 
ically, I At-' I ^ 5 • 10"^'' eV. It explains the presence 
of a "flat direction" in the , which extends the 
allowed region to large NSI couplings. This direc- 
tion is a parabola on planes of constant Cee- Trans- 
versely to it, the function grows rapidly, as can 
be seen from our figures. The second condition is on 
the mixing angle that describes the flavor composi- 
tion of the eigenstates of the matter Hamiltonian: 
(3 ^ 0.37r ~ 57°. It follows from requiring con- 
sistency between atmospheric data samples of dif- 
ferent energy and/or between the atmospheric data 




FIG. 6: The same as Fig. [Hfor 



normal mass hierarchy. 
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FIG. 7: The same as Fig. |21for normal mass hierarchy. 

and the (practically) matter-free K2K results. This 
condition explains the worsening of the fit along the 
parabolic flat direction. 

In terms of the epsilons, we see that the allowed 
range of e^r and trr strongly depends on the value 
of eee, which in turn is unconstrained by atmo- 
spheric neutrinos. Both ef.^ and trr are most con- 
strained for €ee= —1, and the constraint rapidly 
weakens as eee is increased. For eee= 1-5 and in- 
verted mass hierarchy, values as large as e^.^-^ 5 and 
I Eer I ~ 3.5 are allowed along the parabola. These 
would translate into very loose limits on the NSI pa- 
rameters of the effective four-fermion Lagrangian. 
Still, such limits generally improve on existing ac- 
celerator bounds. 




-2-10 1 2 

FIG. 8: An example of how the contours of Fig. Qchange with 
non-zero ^13. This plot refers to e^e— and sin^ On = 0.02, 
with Sis > 0. 



2. The inclusion of NSI in the analysis modifies the al- 
lowed region of the vacuum oscillation parameters, 
sin^ 023 and Amg^^ . As our analytical treatment 
shows, the fit to large NSI is achieved at the ex- 
pense of changing the values of the vacuum oscilla- 
tion parameters. After marginalizing over the NSI 
couplings and the sign of the mass squared split- 
ting, we find that the region in the space of sin^ ^23 
and |Ato|]^| is larger than that of the standard, no- 
NSI case. Smaller mixing and larger mass splitting 
are allowed. If we fit the data to one parameter 
at a time, and marginalize over all the others (see 
Tabled) we find the intervals sin^ 6*23 = 0.24 - 0.68 
and |Ato2J ^ (1.7 _ 3.9) . io-3 eV^ at 3cr C.L. ( 

to be compared to the results of the standard case: 
sin2e'23 = 0.32 - 0.66 and |Amii| = (1.7 - 3.6) • 
10"^ eV^). 

3. The recent K2K results play an important role in 
limiting NSI. This stems from the fact that for the 
K2K setup matter effects are negligible, and there- 
fore K2K measures the true vacuum oscillations pa- 
rameters. The K2K constraint on the oscillation 
parameters, particularly on |Am|]^|, translates in a 
constraint on NSI, by limiting the range over which 
the oscillation parameters could be varied to com- 
pensate for the effects of large NSI. As an example, 
for Cee-- 0(10^1), the addition of the K2K results 
restricts the region of the NSI couplings by about 
^ 25% in the direction of e-rr (Fig. 0, with respect 
to the analysis of atmospheric neutrinos only. 

4. We have studied the dependence of the results on 
the mass hierarchy (sign of Am§i). The allowed 
region of the NSI couplings has the same shape for 
both hierarchies, but, for eee^ —1, it is more ex- 
tended for the inverted hierarchy by up to a factor 
of ^ 2 in the direction of e-j-r- Subdominant effects 
due to have been analyzed. They mainly break 
the degeneracy in the sign (phase) of eer- Cor- 
rections due to the smaller mass squared splitting, 
Am2i, turn out to be quite small. 

Our results represent a step toward the reconstruction 
of the region in the space of NSI couplings that is com- 
patible with all existing data. One of the next steps is 
the extension of the analysis to include the solar neutrino 
and KamLAND data. While it is known that the latter 
do not exclude large NSI couplings along the parabolic 
region H17|l (l^, a detailed study has not been done be- 
fore; it is presented in a companion paper of this work, 
soon to be completed |63 |. 

The fact that still large NSI in the e — r sector are not 
experimentally excluded has important implications for 
other aspects of neutrino physics. First, it is an impor- 
tant motivation for neutrino experiments with man-made 
sources. Experiments with neutrino beams of short or in- 
termediate base-line, such as MINOS or OPERA 113 
will have negligible matter effects, and will increase the 
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precision of the measurement of ^23 and |Am|]^|. This in- 
creased precision will leave even less room for NSI, or give 
indication of their existence, depending on whether the 
measured vacuum parameters are in agreement or in ten- 
sion (especially if the tension is in the direction of smaller 
mixing and/or larger mass splitting) with the analysis of 
atmospheric neutrino with standard interactions only. 

Neutrino beams with energy _B ~ 1 — 10 GeV and 
long base-line (of the order of thousands of Km) like the 
proposed Fermilab-to-Soudan design, for example, would 
exhibit dramatic effects of NSI in the disappearance of 
muon neutrinos (or antineutrinos) as well as in the ap- 
pearance channel v^^Ve (or D^^Ve). In the disappear- 
ance channel NSI would produce an irregular pattern of 
oscillations minima and maxima, due to all three neu- 
trinos being involved in the oscillations, in contrast with 
the simpler two-neutrino Vf^^Vr oscillations expected in 
absence of NSI. The appearance channel v^^Ve would be 
particularly characteristic in the fact that the compo- 
nent could be much larger than what allowed by standard 
interactions and subdominant effects (those of ^13 and of 
Am^i) and would not be suppressed at high energy - in 
contrast with the case of the MSW effect with standard 
interactions - as a consequence of flavor-changing NSI. 
In the high-energy limit, i.e. where the matter potential 
in the Earth dominates over vacuum terms, the ampli- 
tude of the v^^Ve oscillation would be controlled by the 
matter mixing (3: 



(25) 



where P(f^, 



is given in Eq. 1)16(1 and is unsup- 



pressed at high energy for NSI along the parabola (|17|) . 

The presence of NSI can also alter significantly the 
physics of supernova neutrinos, in a way that may 
be tested with data from a future galactic supernova. 
Firstly, in the outer regions of the collapsing star, the 
NSI couplings may produce a richer structure of level- 
crossings with respect to the two MSW resonances of the 
standard case. New resonances may, in principle, appear 
depending on the chemical composition of the medium 
in the star and on what scatterers are responsible for 
the NSI. A less trivial effect will be on the evolution 
of trapped neutrinos inside the core of the protoneutron 
star. Here, NSI may affect the explosion itself, by chang- 
ing the dynamics of the core and the energetics of the 
shock wave. This fundamental effect has been overlooked 
until recently |66|. More work is required to understand 
the full implications of NSI, including possible changes in 
the r-processes and in the energy deposition by neutrinos 
in the matter of the star. 
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APPENDIX A: ESTIMATING CORRECTIONS 

DUE TO 6*13 



As seen in Fig. |S1 the effect of nonzero ^13 is to break 
the ^er^ ^ £eT Symmetry, while preserving the general 
parabolic shape of the region. These features can be 
understood by generalizing our analytical description of 
Sec. nil Bl The corrections due to 6*13 enter the vacuum 
part of the Hamiltonian, and therefore influence those 
predictions that depend on vacuum terms, like the mix- 
ing and mass splitting in matter, Eq. (|15|l . and the "cut- 
off" conditions ((22|l and 1(23(1 . One expects an interplay 
between terms and ^13 terms, since both couple i^e to 
Vt- This interplay has the form of an additive interfer- 
ence, analogous to the one involving the vacuum terms 
and the standard interaction in the MSW effect. This is 
the origin of the breaking of the symmetry in the sign 

(phase) of Cer- 

Expanding the Hamiltonian in Eq. ((14() along the 
parabolic direction l(17() to first order in sin 2^13, we find 
the generalizations of Eqs. ((20(1 and ((21(1 : 



cost 



sin 2f?i3S2/3 cos(2V' — 8) 



2 l-Hcos"2/5 



4(1 + c^) 

sin 2^13 tan (5 



(1+C0S2 /3)3/2 



(Al) 
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As in Eqs. I(2U() and 1(21(1 . these expressions give the values 
of the vacuum parameters that correspond to 9m ~ 7r/4 
and a given value of the mass splitting in matter, Am^. 

The generalized form of the condition 1(221) is 
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C.L. 


sm^ Ota 


1 A 2 1 / 1 r\ — 3 \ r'2 

Am3i /lO eV 


sm 623 (no-NSI) 


jAm3ij/10 eV (no-NSI) 


95% 


0.31 - 0.64 


2.0 - 3.4 


0.36 - 0.60 


2.0 - 3.2 


99% 


0.26 - 0.66 


1.8 - 3.7 


0.34 - 0.64 


1.8 - 3.5 


3a 


0.24 - 0.68 


1.7 - 3.9 


0.32 - 0.66 


1.7 - 3.6 



TABLE I: The allowed intervals of the vacuum mixing parameters, sin^ S23 and |Am3i|. Each interval has been obtained by 
marginalizing over all the parameters except the one in question. The same results for the standard case (no NSI) are shown 
for comparison. 



tan"^ 



1 - sin 26*1306 cos(2-0 - (5) < tan/3 < 

I 



tan 



1 — sin 2013C0 008(2-0 — 5) 



(A2) 



Eqs. lfrni-ll2ll are accurate to the order sin 2013, while 
C(sin^ 6*13) or higher terms are not under control. We 
have neglected terms proportional to A^/ / A <C 1 (which 
is accurate along the parabola) . The ^13 correction to Eq. 
(|23|l is more complicated and will not be given here. We 
notice that the ^13 term in Eqs. IjAip comes as a prod- 
uct with sin (3 from an expansion of terms of the type 
|Asin/3/A + sin6'i3e**p; this confirms the MSW-like in- 
terference mentioned above. One can also see how results 
depend on the relative phase itp — 5 oi the matter and 



vacuum terms. For ^23 in the first octant, ip = 5 = 0, and 
6*13 > Eq. ljA2p gives a stronger restriction for positive 
rather than negative Cer ■ Similarly, from ljAl|) we see that 
a positive eer would increase the ratio Am^/Am^^j, thus 
making the tension with the low-energy sample and/or 
with K2K stronger. Both of these features correspond 
to the trend observed in Fig. [S] We have checked that 
there is also quantitative agreement between numerical 
and analytical results (Eqs. (|A1|) - (|A2|) ) at the order of 
magnitude level. 
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